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Cross-Reference to Related Applications 
[0001] This application is a continuation patent application of U.S. Application No. 
09/591,140, filed June 9, 2000, currently pending, 
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STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT 
[0002] The invention described herein was made in the performance of work under NASA 
Small Business Innovation Research (SBIR) Contract NAS4-99012, and is subject to the 
provisions of Public Law 96-517 (35 USC 202) and the Code of Federal Regulations 48 CFR 
52.227-1 1 as modified by 48 CFR 1852.227-1 1, in which the contractor has elected to retain title. 
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FIELD OF THE INVENTION 
[0003] The instant invention relates generally to a system and method for process parameter 
estimation using operating mode partitioning and, in particular, to a system and method for 
performing high sensitivity surveillance of an asset such as a process and/or apparatus preferably 
having at least two distinct modes of operation wherein surveillance is performed using an 
operating mode partitioned parameter estimation model of the asset. 
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BACKGROUND OF THE INVENTION 
[0004] Conventional process surveillance schemes are sensitive only to gross changes in the 
mean value of a process signal or to large steps or spikes that exceed some threshold limit value. 
These conventional methods suffer from either a large number of false alarms (if thresholds are 
set too close to normal operating levels) or from a large number of missed (or delayed) alarms (if 
the thresholds are set too expansively). Moreover, most conventional methods cannot perceive 
the onset of a process disturbance or sensor signal error that gives rise to a signal below the 
threshold level or an alarm condition. Most conventional methods also do not account for the 
relationship between a measurement by one sensor relative to another sensor. 
[0005] Recently, improved methods for process surveillance have developed from the 
application of certain aspects of artificial intelligence technology. Specifically, parameter 
estimation methods have been developed using either statistical, mathematical or neural network 
techniques to learn a model of the normal patterns present in a system of process signals. After 
learning these patterns, the learned model is used as a parameter estimator to create one or more 
virtual signals given a new observation of the actual process signals. Further, high sensitivity 
surveillance methods have been developed for detecting process and signal faults by analysis of a 
mathematical comparison between the actual process signal and its virtual signal counterpart. 
[0006] Parameter estimation based surveillance schemes have been shown to provide 
improved surveillance relative to conventional schemes for a wide variety of assets including 
industrial, utility, business, medical, transportation, financial, and biological systems. However, 
parameter estimation based surveillance schemes have in general shown limited success when 
applied to complex processes. Applicant recognizes and believes that this is because the 
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parameter estimation model for a complex process must characterize the entire operating state 
space of the process to provide effective surveillance. Moreover, a review of the known prior-art 
discloses that virtually all such systems developed to date utilize a single model of the process to 
span the entire set of possible operating modes. Hence, a significant shortcoming of the known 
prior-art is that, inter alia, statistically derived models become extremely large and neural 
network models become difficult or impractical to train when the process operating state space is 
complex. The implication for statistically derived models is that the parameter estimation 
method and system becomes computationally expensive to operate thereby limiting the utility of 
the method for on-line or real-time surveillance. An alternative for statistically derived models is 
to constrain the size of the model; however this constraint limits the accuracy of the parameter 
estimation method and thereby limits the sensitivity of the surveillance method. The implication 
for mathematical and neural network models is simply that the parameter estimation method and 
system becomes less accurate thereby degrading the sensitivity of the surveillance method. 
[0007] Many attempts to apply multivariate state estimation techniques, mathematical 
modeling techniques and neural network techniques to assets such as industrial, utility, business, 
medical, transportation, financial, and biological processes have met with poor results in part 
because the parameter estimation models used were expected to characterize the entire operating 
state space of the process. In one example, a multivariate state estimation technique (MSET) 
based surveillance system for the Space Shuttle Main Engine's telemetry data was found to 
produce numerous false alarms when the learned MSET parameter estimation model was 
constrained to a size suitable for on-line, real-time surveillance. In this case, the surveillance 
system false alarm rate could be reduced by desensitizing the surveillance threshold parameters; 
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however, the missed alarm rates then became too high for practical use in the telemetry data 
monitoring application. 

[0008] Moreover, current multivariate state estimation techniques, mathematical modeling 
techniques and neural network techniques for surveillance of assets such as industrial, utility, 
business, medical, transportation, financial, and biological processes fail to recognize the 
surveillance performance limitations that occur when it becomes necessary to trade-off decision 
processing speed against decision accuracy. This may be attributed, in part, to the relative 
immaturity of the field of artificial intelligence and computer-assisted surveillance with regard to 
real-world process control applications. Additionally, a general failure to recognize the specific 
limitations of trading off decision processing speed against decision accuracy for computer- 
assisted surveillance is punctuated by an apparent lack of known prior art teachings that address 
potential methods to overcome this limitation. In general, the known prior-art teaches computer- 
assisted surveillance solutions that are either applied globally to all operating modes of an asset 
or applied only to a single predominant operating mode, for example, applied only to steady state 
operations while neglecting all transient operating states of the asset. 

[0009] For the foregoing reasons, there is a need for a surveillance system and method that 
overcomes the significant shortcoming of the known prior-art as delineated hereinabove. 
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BRIEF SUMMARY OF THE INVENTION 
[0010] The instant invention is distinguished over the known prior art in a multiplicity of 
ways. For one thing, one embodiment of the invention provides a surveillance system and 
method that partitions parameter estimation models of an asset for overcoming a performance 
limiting trade-off between decision processing speed and decision accuracy that has been 
generally unrecognized by the known prior-art. Additionally, one embodiment of the invention 
can employ any one of a plurality of parameter estimation methods and the process models used 
therewith for improving surveillance performance. Furthermore, one embodiment of the 
invention provides a surveillance system and method that provides an operating mode partitioned 
parameter estimation model that can be accomplished by observation and analysis of a time 
sequence of process signal data and by a combination of a plurality of techniques. 
[0011] Moreover, one embodiment of the invention provides a surveillance system and 
method that provides an operating mode partitioning of the parameter estimation model which 
enables different parameter estimation methods, thresholds and decision logic to be used for 
surveillance within each individual operating mode of an asset. This ability enables surveillance 
to be performed by the instant invention with lower false alarm rates and lower missed alarm 
rates than can be achieved by the known prior-art methods. 

[0012] Hence, one embodiment of the invention provides a surveillance system and method 
that performs its intended function much more effectively by enabling higher decision processing 
speed without a concomitant reduction in decision accuracy. Conversely, one embodiment of 
the invention alternately enables improved decision accuracy without a concomitant reduction in 
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decision processing speed. Additionally, these competing criteria may be traded-off to achieve 
the optimal performance solution for a specific surveillance application. 

[0013] Furthermore, and in contrast to the known prior art, and in one embodiment of the 
invention, parameter estimation methods, thresholds and decision logic may be individually 
tailored for each operating mode of the asset thereby providing additional capability to reduce 
decision error rates for the surveillance system. 

[0014] In one embodiment of the invention, the instant invention provides a surveillance 
system and method that creates and uses, for the purpose of process surveillance, a coordinated 
array of process parameter estimation submodels wherein each process submodel in the 
coordinated array is optimized for a single process operating mode or subset of operating modes 
of an asset. 

[0015] In another embodiment of the invention, a method for determining asset status 
includes the steps of creating a process model comprised of a plurality of process submodels each 
correlative to at least one training data subset partitioned from an unpartitioned training data set 
and each having an operating mode associated thereto; acquiring a set of observed signal data 
values from an asset; determining an operating mode of the asset for the set of observed signal 
data values; selecting a process submodel from the process model as a function of the determined 
operating mode of the asset; calculating a set of estimated signal data values from the selected 
process submodel for the determined operating mode, and determining asset status as a function 
of the calculated set of estimated signal data values. 

[0016] In another embodiment of the invention, a system for determining asset 

status is comprised of a training data set partitionable into a plurality of training data subsets 
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having a plurality of predefined operating modes associated therewith such that each partitioned 
training data subset includes at least one of said predefined operating modes associated thereto; 
means for acquiring a set of observed signal data values from an asset; means for determining an 
operating mode of the asset for the set of observed signal data values; means for selecting a 
process submodel from a process model as a function of said determined operating mode of the 
asset; means for calculating a set of estimated signal data values from said selected process 
submodel for said determined operating mode for performing asset surveillance, and means for 
determining asset status as a function of the calculated set of estimated signal data values. 
[0017] In another embodiment of the invention, an asset surveillance system is comprised of 
a data acquisition means for acquiring a set of signals from an asset correlative to asset status; a 
digitizing means for digitizing said set of signals for defining a set of digitized signals; a process 
model comprised of a plurality of process submodels each correlative to at least one training data 
subset partitioned from an unpartitioned training data set and wherein each of said partitioned 
training data subsets and each of said plurality of process submodels has at least one defined 
operating mode associated therewith; an operating mode determination means for determining an 
operating mode of said asset; a process model selection means for selecting at least one of said 
process submodels as a function of said determined operating mode; a parameter estimation 
means for producing a set of estimated signal values from said selected process submodel; a fault 
detection means for detecting the presence of a fault as a function of said set of estimated signal 
values from said selected process submodel for providing asset surveillance. 
[0018] In another embodiment of the invention, a method for performing surveillance of an 
asset includes the steps of creating a process model comprised of a plurality of process 
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submodels each correlative to at least one training data subset partitioned from an unpartitioned 
training data set and each having an operating mode associated thereto; acquiring a set of 
observed signal data values from the asset; determining an operating mode of the asset for the set 
of observed signal data values; selecting a process submodel from the process model as a 
function of the determined operating mode of the asset; calculating a set of estimated signal data 
values from the selected process submodel for the determined operating mode, and determining 
asset status by performing the step of comparing the set of observed signal data values to the 
calculated set of estimated signal data values for performing asset surveillance. 
[0019] Moreover, having thus summarized the invention, it should be apparent that 
numerous modifications and adaptations may be resorted to without departing from the scope and 
fair meaning of the present invention as set forth hereinbelow by the claims 



[Continuation Patent Application - 23404- cpa - Page 11] 



n 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0020] Figure 1 is a schematic functional flow diagram of an embodiment of the invention. 
[0021] Figure 2 is a schematic functional flow diagram of a method and system for training 
an operating mode partitioned array of parameter estimation models using recorded observations 
of the actual process signals in an embodiment of the invention. 

[0022] Figure 3 is a schematic functional flow diagram of a method and system for 
performing surveillance of an asset using an operating mode partitioned array of parameter 
estimation models in an embodiment of the invention. 

[0023] Figure 4 is a schematic functional flow diagram of a surveillance procedure using an 
operating mode partitioned parameter estimation model in an embodiment of the invention. 
[0024] Figure 5 is a schematic functional flow diagram of a method and system for the 
MSET training procedure in an embodiment of the invention. 

[0025] Figure 6 is a schematic functional flow diagram of a method and system for the 
MSET surveillance procedure in an embodiment of the invention. 

[0026] Figure 7 illustrates the relationship between the overall MSET parameter estimation 
error and the number of observation vectors used in the process memory matrix when 
unpartitioned process modeling methods are used for MSET training and surveillance; 
[0027] Figure 8 illustrates the relationship between the data processing time required for 
producing an MSET parameter estimate and the number of observation vectors used in the 
process memory matrix when unpartitioned process modeling methods are used for MSET 
training and surveillance. 
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[0028] Figure 9 is a schematic functional flow diagram of the training procedure for an 
embodiment using an operating mode partitioned array of MSET parameter estimation models in 
an embodiment of the invention. 

[0029] Figure 10 is a schematic functional flow diagram of the surveillance procedure for an 
embodiment using an operating mode partitioned array of MSET parameter estimation models in 
an embodiment of the invention. 

[0030] Figure 1 1 is a schematic architecture diagram of a learning vector quantization neural 
network useful for classifying the operating mode of an asset in an embodiment of the invention. 
[0031] Figure 12 lists the learning vector quantization neural network operating mode 
classifier design characteristics used for feasibility testing of an embodiment of the invention. 
[0032] Figure 13 lists the Space Shuttle Main Engine parameters used for feasibility testing 
in an embodiment of the invention. 

[0033] Figure 14 lists the Space Shuttle Main Engine flight telemetry data sets used for 
feasibility testing of an embodiment of the invention. 

[0034] Figure 15 lists the parameter estimation model and model array configurations used 
for feasibility testing of an embodiment of the invention. 

[0035] Figure 16 lists the Space Shuttle Main Engine operating mode partitioning rules used 
for feasibility testing of an embodiment of the invention. 

[0036] Figure 17 lists the feasibility test results for nominal flight data using an embodiment 
of an operating mode partitioned MSET process model array for the Space Shuttle Main Engine 
in an embodiment of the invention. 
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[0037] Figure 18 lists the feasibility test results for signal drift failure detection simulations 
using an embodiment of an operating mode partitioned MSET process model array for the Space 
Shuttle Main Engine in an embodiment of the invention. 

[0038] Figure 19 lists the comparative test results for nominal flight data using an 
unpartitioned MSET model for the Space Shuttle Main Engine containing one hundred fifty 
observation vectors. 

[0039] Figure 20 lists the comparative test results for signal drift failure detection using a 
unpartitioned MSET model for the Space Shuttle Main Engine containing one hundred fifty 
observation vectors. 

[0040] Figure 21 lists the comparative test results for nominal flight data using a 
unpartitioned MSET model for the Space Shuttle Main Engine containing three hundred 
observation vectors. 

[0041] Figure 22 lists the comparative test results for signal drift failure detection using a 
unpartitioned MSET model for the Space Shuttle Main Engine containing three hundred 
observation vectors. 

[0042] Figure 23 illustrates a mathematical process model relation of a type used for Space 
Shuttle Main Engine telemetry data surveillance in an another embodiment. 
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DETAILED DESCRIPTION OF THE INVENTION 
[0043] Considering the drawings, wherein like reference numerals denote like parts 
throughout the various drawing figures, reference numeral 10 is directed to the system according 
to the instant invention. 

[0044] In its essence, and referring to figure 1, the system 10 is generally comprised of a 
method and apparatus for performing high sensitivity surveillance of a wide variety of assets 
including industrial, utility, business, medical, transportation, financial, and biological processes 
and apparatuses wherein such process and/or apparatus asset preferably has at least two distinct 
modes or domains of operation (e.g., transient and steady state modes or domains). The system 
includes a training procedure 20 wherein a parameter estimation process model array 50 of an 
asset 12 (e.g., a process and/or apparatus) is learned from historical operating data using at least 
one of a plurality of computer-assisted techniques. Historical operating data includes a set of 
observations from normal operation of the asset 12 that is acquired and digitized by a data 
acquisition means 40 using any combination of electronic data acquisition hardware and signal 
processing software known to those having ordinary skill in the art, and informed by the present 
disclosure. Additionally, and as delineated infra, one hallmark of the instant invention is an 
operating mode partitioning method of a parameter estimation process model array 50 for the 
asset 12 which is performed during the training procedure 20. 

[0045] The system 10 further includes a surveillance procedure 60 wherein the operating 
mode partitioned parameter estimation process model array 50 is used for high sensitivity 
computer-assisted surveillance of the asset 12 for the purpose of determining whether a process 
fault or failure necessitates an alarm or control action. Another hallmark of the instant invention, 
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as delineated hereinbelow, is the use of the operating mode partitioned parameter estimation 
process model array 50 as an element of the surveillance procedure 60. The system 10 described 
herein is useful for ultra-sensitive detection of the onset of sensor or data signal degradation, 
component performance degradation, and process operating anomalies. 
[0046] Description of the Training Procedure: 

[0047] More specifically, and referring to figure 2, the training procedure 20 of the system 
10 includes a method and apparatus for training or preparing the process model array 50 using 
historical operating data from the asset 12 that has been acquired by the data acquisition means 
40 using any combination of conventional electronic data acquisition hardware and signal 
processing software as is well known in the art. The historical operating data is acquired in 
digital format and stored using a data storage procedure 22 to create a training data set 24. The 
training data set 24 includes at least N discrete observations of the asset 12 wherein each single 
observation, herein denoted Xobs, is comprised of a vector of data values for each signal 
parameter to be included in the process model array 50. For the purposes of the training 
procedure 20, the number of observations, N, acquired is at least great enough to adequately 
bound the operating state space of the asset 12. Thus, the training data set 24 provides a 
representative sample of the signals produced by the asset 12 during all normal modes of 
operation. 

[0048] Again referring to figure 2, upon acquiring the training data set 24 the designer 
proceeds to implement the unique method for the training procedure 20 in accordance with 
instant invention. The unique method for the training procedure 20 is comprised of partitioning 
the training data set 24 into subsets wherein a training data subset 28 is representative of a single 
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operating mode or subset of operating modes of the asset 12. Further, the unique method for the 
training procedure 20 also includes a process submodel creation procedure 30 for creating at least 
one process submodel for inclusion in the process model array 50 using at least one training data 
subset 28. In practice, the designer first selects the operating modes that will be included in the 
process model array 50 by means of an operating mode enable procedure 32. The method 
thereafter is comprised of a training loop wherein each possible operating mode of the asset 12 is 
assessed for inclusion in the process model array 50. 

[0049] The training loop is in general controlled by two decision procedures. The mode 
enabled decision procedure 34 determines whether the designer intends a specific operating mode 
to be included in the process model array 50. If the operating mode is not to be included, no 
further processing is required and the training loop proceeds to the next possible operating mode 
as controlled by the more modes decision procedure 36. If the operating mode is to be included, 
all observations included in the training data set 24 are assessed using the operating mode 
determination procedure 26 in order to extract the training data subset 28 specific to the currently 
selected operating mode. Depending on the preference of the designer implementing the training 
loop, the operating mode determination and training data subset extraction procedures may be, in 
general, performed as needed or in advance of the training loop. The training loop shown in 
figure 2 illustrates operating mode determination and extraction on an as needed basis but is not 
intended to constrain the method to preclude determination and extraction in advance of 
implementing the training loop. The final step in the training loop is a process submodel creation 
procedure 30. The process submodel creation procedure 30 creates the parameter estimation 
submodel for the currently selected operating mode and trains the submodel using the training 
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data subset 28 specific to the currently selected operating mode. The process submodel creation 
procedure 30 further stores this submodel as a new element in the process model array 50. 
[0050] Still referring to figure 2, the operating mode determination procedure 26 used to 
classify each observation included in the training data set 24 may be, in general, performed using 
any method suitable for determining the operating mode of the asset 12 given an observation or 
series of observations therefrom. Methods suitable for the operating mode determination 
procedure 26 include, but are not limited to, a plurality of mathematical or logic sequence 
techniques, a plurality of expert system techniques, a plurality of fuzzy logic techniques, and a 
plurality of neural network techniques. 

[0051] Continuing to refer to figure 2, the process submodel creation procedure 30 may be, 
in general, performed using any method suitable for defining a parameter estimation model 
useful for estimating the values of one or more process signals. Methods suitable for the process 
submodel creation procedure 30 include, but are not limited to, a plurality of multivariate state 
estimation techniques, a plurality of neural network techniques, a plurality of mathematical 
model techniques, a plurality of autoregressive moving average techniques, and a plurality of 
Kalman filter techniques. Each process submodel contained in the process model array 50 may 
be created to implement any one of a plurality of parameter estimation techniques. Further, the 
parameter estimation technique implemented for an individual submodel is not constrained to be 
the same as the parameter estimation technique implemented for any other submodel contained in 
the process model array 50. 

[0052] The training procedure 20 is completed at training complete point 37 when all 
possible operating modes of the system 10 have been assessed. At this point, the process model 
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array 50 includes parameter estimation models for each operating mode enabled by the designer. 
The process model array 50 is thereafter useful for performing surveillance of the asset 12. 
[0053] Description of the Surveillance Procedure: 

[0054] More specifically, and referring to figure 3, the surveillance procedure 60 is 
comprised of acquiring successive vectors of current operating data and determining for each 
such observation vector whether the current operating data is indicative of a fault or failure of the 
asset 12. The surveillance procedure 60 further includes implementing an alarm or control action 
for the purpose of notifying an operator or taking a corrective action in response to a detected 
fault or failure of the asset 12. The surveillance procedure 60 is in general an open-ended data 
acquisition and analysis loop that continues until such time as the operator chooses to terminate 
the surveillance. 

[0055] Again referring to figure 3, the surveillance procedure begins with an observation 
acquisition procedure 62 for acquiring a current vector of observed signal data values, herein 
denoted Xobs. Signal data values are acquired by the data acquisition means 40 using any 
combination of conventional electronic data acquisition hardware and signal processing software 
as noted supra. Next the operating mode determination procedure 26 is used to determine the 
operating mode for the current vector of observed signal data values, Xobs. It is essential only 
that the operating mode determination procedure 26 used during the surveillance procedure 60 is 
the same operating mode determination procedure 26 used during the training procedure 20. 
Upon determination of the current operating mode for the current observed signal data, the 
process submodel for the current operating mode is selected from the array of submodels 
contained in the process model array 50 using a process submodel selection procedure 64. The 
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selected process submodel for the current operating mode is then used with a parameter 
estimation procedure 66 to produce a current vector of estimated signal data values, herein 
denoted Xest. It is essential only that the parameter estimation procedure 66 used during the 
surveillance procedure 60 is the same parameter estimation procedure 66 for which the process 
submodel was trained using the process submodel creation procedure 30 during the training 
procedure 20. The current vector of estimated signal data values, Xest, in general includes at 
least one estimated signal data value corresponding to at least one actual signal data value 
included in the current vector of observed signal data values, Xobs. A series of estimated signal 
data values produced by successive observation and parameter estimation cycles is termed herein 
a "virtual signal" for the signal parameter. 

[0056] Still referring to figure 3, the current vector of estimated signal data values, Xest, 
may be in general compared to the current vector of observed signal data values, Xobs, using a 
fault detection procedure 68. The fault detection procedure 68 serves the useful purpose of 
determining whether the current vector of observed signal data values indicates a fault or failure 
of a component of the asset 12. The fault detection procedure 68 may be performed using any 
one of a plurality of comparative techniques including, but not limited to, evaluation of the 
current comparison result against numerical limit values, evaluation of the current comparison 
result using any one of a plurality of statistical hypothesis test techniques, evaluation of the 
current comparison result using any one of a plurality of expert system techniques, and 
evaluation of the current comparison result using any one of a plurality of neural network 
techniques. Figure 3 illustrates the use of a mathematical difference (Xobs - Xest) to calculate 
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the residual error between the observed and estimated signals but is not intended to preclude any 
other form of comparison whatsoever. 

[0057] The results of the fault detection procedure 68 provide fault detection for the current 
vector of observed signal data values. In many cases, fault detection decision quality is improved 
by using a fault decision procedure 70 that incorporates logic for considering a series of 
observations in making the fault detection decision. The fault decision procedure 70 may be in 
general performed using any method suitable for ascertaining a fault of the asset 12 given a fault 
detection result or series of fault detection results therefrom. Methods suitable for the fault 
decision procedure 70 include, but are not limited to, single observation techniques (e.g., alarm 
on every detected fault), multi-observation voting techniques (e.g., alarm when X out of Y 
observations contain a fault indication), and conditional probability techniques (e.g., compute the 
fault probability given a series of fault detection results). Upon completing the fault decision 
procedure 70, the surveillance procedure then repeats for as long as a more data decision 
procedure 72 determines that additional surveillance data are available or terminates at 
surveillance complete step 75 when no more surveillance data are available. 
[0058] Continuing to refer to figure 3, the usefulness of the instant invention is, inter alia, 
the improvement achieved in the accuracy of the fault detection decision made by the fault 
decision procedure 70. Improving the accuracy of the fault decision procedure 70 accomplishes a 
reduction in the number of false alarms sent to a process operator or control system that can in 
turn result in an erroneous alarm or control action by the alarm or control action procedure 74. 
Further, improving the accuracy of the fault decision procedure 70 accomplishes a reduction in 
the number of missed alarms thereby accomplishing more timely alarm or control action by the 
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alarm or control action procedure 74. The instant invention thereby enables improved operating 
safety, improved efficiency and performance, and reduced maintenance costs for a wide variety 
of industrial, utility, business, medical, transportation, financial, and biological processes and 
apparatuses wherein such process and/or apparatus asset 12 preferably has at least two distinct 
modes or domains of operation. 

[0059] Figure 4 outlines a general surveillance procedure of the system 10 when employing 
the operating mode partitioned parameter estimation process model array 50. In a typical 
surveillance procedure, the asset 12 is the source of at least one process signal 42 that is acquired 
and digitized using conventional data acquisition means 40 for providing the data acquisition 
procedure for the purpose of computer-assisted surveillance. The digitized signal data is 
generally evaluated using a computer 44 having computer software modules implementing the 
operating mode determination procedure 26, the parameter estimation procedure 66, and the fault 
detection procedure 68. The operating mode determination procedure 26 is used to determine the 
current operating mode of the asset 12 given the acquired process signal data. The parameter 
estimation procedure 66 is used to produce an estimated signal value for at least one process 
signal 42 emanating from the asset 12. The parameter estimator procedure 66 in general makes 
use of the process model array 50 stored in a memory means 48 associated with the computer 44 
to produce the estimated signal values. The specific process submodel selected from the process 
model array 50 and used by the parameter estimation procedure 66 is dependent on the operating 
mode determined by the operating mode determination procedure 26. The estimated signal 
values are then generally evaluated using the fault detection procedure 68 to identify faults or 
operating anomalies in the asset 12. The results of the fault detection evaluation are thereafter 
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communicated by a conventional communications link 80 (as is known to those having ordinary 
skill in the art, and informed by the present disclosure) to an operator console 82 or automated 
process control system 84 for possible alarm and/or control action. 

[0060] The computer 44 along with the associated memory means 48 can also be employed 
to perform the training and surveillance procedures 20, 60 as delineated supra and to store all the 
data associated with these procedures, for example, the historical operating data, the training data 
and process model array. 
[0061] MSET Procedure: 

[0062] In an embodiment of the invention, the method used for parameter estimation is a 
multivariate state estimation technique (MSET) procedure. The US Department of Energy's 
Argonne National Laboratory originally developed the implementation of MSET described 
herein for surveillance of sensors and components in nuclear power plant applications. However, 
other implementations of a multivariate state estimation technique are possible and useful in 
conjunction with the instant invention. MSET is in general a statistically derived parameter 
estimation algorithm that uses advanced pattern recognition techniques to measure the similarity 
or overlap between signals within a defined operational domain (set of process operating states). 
MSET "learns" patterns among the signals by numerical analysis of historical process operating 
data. These learned patterns or relationships among the signals are then used to identify the 
learned state that most closely corresponds with a new signal data observation. By quantifying 
the relationship between the current and learned states, MSET estimates the current expected 
response of the process signals. MSET then uses a form of statistical hypothesis testing, such as 
the sequential probability ratio test (SPRT) or similar probability ratio test algorithm (as shown 
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in US Patent 5,459,675 and which is hereby incorporated by reference in its entirety) to compare 
the current estimated value of a signal with its observed value. The statistical hypothesis 
comparison test provides a sensitive and widely applicable method to detect a fault or failure in 
an asset. However, other implementations of the comparison test are possible and useful in 
conjunction with the instant invention. 

[0063] An MSET model is created for the asset 12 using the MSET training algorithms to 
learn the inherent data relationships within a set of historical process operating data. The trained 
MSET model is then used with the MSET parameter estimation and fault detection algorithms to 
perform the process surveillance function when presented with a new observation of signal data 
values. The following sections will first provide a mathematical overview of the MSET 
algorithms and procedures useful for training a parameter estimation model and for using this 
trained model for process surveillance. The description is followed by a detailed description of 
an embodiment of the invention using a novel operating mode partitioned MSET process model 
array for parameter estimation and process surveillance. 
[0064] Description of the MSET Training and Surveillance Procedures: 
[0065] The MSET methods are generally described in the following two US Government 
documents produced and maintained by the US Department of Energy's Argonne National 
Laboratory, Argonne, Illinois, disclosure of which is incorporated in its entirety herein by 
reference. 
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• J.P. Herzog, S.W. Wegerich, R.M. Singer, and K.C. Gross, "Theoretical Basis of the 
Multivariate State Estimation Technique (MSET)," Argonne National Laboratory, 
ANL-NT-49, December 1997. 

. J. P. Herzog, S. W. Wegerich, K. C. Gross, and R. M. Singer, "MSET: Code Structure 
and Interface Development Guide," ANL-NT-48, August 1997. 

[0066] The MSET algorithm uses pattern recognition with historical operating data from an 
asset to generate a parameter estimation model. If data are collected from a process over a range 
of operating states, these data can be arranged in matrix form, where each column vector (a total 
of m) in the matrix represents the measurements made at a particular state. Thus, this matrix will 
have the number of columns equal to the number of states at which observations were made and 
the number of rows equal to the number of measurements (a total of n signal data values) that 
were available at each observation. We begin by defining the set of measurements taken at a 
given time tj as an observation vector X(tj), 

x(t j )=[x 1 (t j ) ( x 2 (t j V-,x n (t j )I r (1) 

where Xj(tj) is the measurement from signal i at time tj. We then define the data 
collection matrix as the process memory matrix D: 



D = 



d U d l,2 d l,n 

d » d » " d '» .[x(t,>x(« ! ),..,X(t m )] (2) 

_ d n,l d n,2"- d n,n 

[0067] Each of the column vectors (X(tj)) in the process memory matrix represents an 
operating state of the process. Any number of observation vectors can be assigned to the process 
memory matrix. Training an MSET model includes collecting enough unique observation 
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vectors from historical operation of the process during normal conditions such that the process 
memory matrix encompasses the full dynamic operating range of the process. Computation of 
the D matrix is the first of three steps in the method for training an MSET model based on 
historical operating data. 

[0068] One of at least two algorithms is used by MSET to select the vectors in the D matrix. 
The MinMax algorithm extracts vectors that bound the vector space defined by the training data 
and returns the smallest process memory matrix that will produce an effective system model (see 
also US Patent 5,764,509 and which is hereby incorporated by reference in its entirety). The 
Vector Ordering algorithm selects and includes representative vectors from the inner regions of 
the vector space producing a more accurate system model. 

[0069] Once the process memory matrix has been constructed, MSET is used to model the 
dynamic behavior of the system. For each current observation of the system (Xobs), MSET 
compares the observation vector to the stored operating states to calculate an estimate of the 
process parameter values. The parameter estimate of the current process state (Xest) is an n- 
element vector that is given by the product of the process memory matrix and a weight vector, 



[0070] The weight vector represents a measure of similarity between the estimate of the 
current state and the process memory matrix. To obtain the weight vector, we minimize the error 
vector, R, where: 



W: 



Xest = D-W 



(3) 




est 



(4) 



[0071] 



The error is minimized for a given state when: 
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(5) 



[0072] This equation represents a "least squares" minimization when the pattern recognition 
operator ® is the matrix dot product. Several advanced pattern recognition operators have been 
defined that provide excellent parameter estimation performance. Pattern recognition operators 
used by MSET include, but are not limited to, the System State Analyzer (SSA) method (see also 
US Patent 4,937,763 and which is hereby incorporated by reference in its entirety), the Bounded 
Angle Ratio Test (BART) method (see also US Patent 5,987,399 and which is hereby 
incorporated by reference in its entirety), the Vector Pattern Recognizer (VPR) method, the 
Vector Similarity Evaluation Technique (VSET) method, and the Probabilistic State Estimation 
Method (PSEM). 

[0073] Once the weight vector is found, the resulting current state estimate of the system 
(i.e., the parameter estimate vector) is given by: 



[0074] The first application of the pattern recognition operator in equation (6) (D T ® D) 
involves a comparison between the row vectors in the D T matrix and each of the column vectors 
in the D matrix. If we define G = D T ® D, then G, the similarity matrix, is an m by m matrix. 
The element in the i-th row and j-th column of the matrix (gy) represents a measure of the 
similarity between the i-th and j-th column vectors (i.e., memorized states) in the process 
memory matrix. The second application of the pattern recognition operator in equation (6) (D T ® 
Xobs) involves a comparison between the row vectors in the D T matrix and each of the elements 
in the observation vector Xobs. If we define A = D T ® Xobs, then A, the similarity vector, is an m 




(6) 
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by 1 vector. Each element in the similarity vector is a measure of the similarity between the 
observation vector and the i-th column vector (i.e., memorized state) in the process memory 
matrix. 

[0075] Note that the similarity matrix is a function of the process memory matrix only. 
Thus, the similarity matrix and its inverse Ginv = (D T ® D)' 1 can be calculated as soon as the 
process memory matrix has been derived thereby making the application of MSET to an on-line 
surveillance system more computationally efficient. Computation of the Ginv matrix initializes 
the process model and completes the second of three steps in the procedure for training an MSET 
model based on historical operating data. 

[0076] The third and final step in the MSET training procedure includes analyzing the 
historical training data using equation (6) to characterize the expected statistical mean and 
variance of the residual error vector, R, for each signal parameter in the observation vector. The 
resulting mean vector, M, is later used in the surveillance procedure to normalize the residual 
error for each observation evaluated using the statistical hypothesis test. The resulting variance 
vector, V, is later used at the beginning of the surveillance procedure to initialize the fault 
detection threshold values used in the statistical hypothesis test. 

[0077] Figure 5 illustrates the procedure for training an MSET parameter estimation model. 
The procedure is used to produce an unpartitioned MSET model 102 that is not partitioned by 
operating mode. The MSET training procedure developed by Argonne National Laboratory 
(ANL) as described herein is embodied in one instance within the ANL software modules known 
as train.c and sys_mod.c. As described herein above, the MSET training procedure begins with a 
MSET model extraction procedure 90 used to populate a process memory matrix 92 (D) from the 
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training data set 24 (historical process operating data). The MSET model extraction procedure 
90 makes use of at least one of a plurality of observation vector extraction methods embodied in 
one instance within the ANL train.c software module, including but not limited to the MinMax 
method, and the Vector Ordering method. A MSET model initiation procedure 94 is the second 
step of the method and is used to initialize the MSET process model by the computation of a 
inverse similarity matrix 96 (Ginv). The MSET model initiation procedure 94 makes use of at 
least one of a plurality of pattern recognition operator methods embodied in one instance within 
the ANL sysmod.c software module, including but not limited to the SSA method, the BART 
method, the VPR method, the VSET method, and the PSEM method. The third step of the 
MSET training procedure uses the process memory matrix 92 and the inverse similarity matrix 
96 to perform a MSET training data analysis procedure 98 using the training data set 24. The 
MSET training data analysis procedure 98 computes the residual error mean and variance vectors 
100 (M and V, respectively) over the training data. The MSET training procedure is in general 
performed once for the training data set 24 thus preparing an unpartitioned MSET model 102 for 
use in the MSET surveillance procedure. 

[0078] In the MSET surveillance procedure, new operating data observations are evaluated 
sequentially using the unpartitioned MSET model 102 for the purposes of validating the data or 
discerning an anomalous (not normal) process operating condition. For each new observation 
vector, Xobs, presented to the MSET parameter estimation method, the memorized state having 
the greatest similarity to the current observed state is returned as a parameter estimate vector, 
Xest. Diagnostic decisions are then made on the basis of the difference (residual error) between 
the observed and estimated values for at least one process signal parameter contained in the 
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estimate vector. MSET uses at least one of a plurality of statistical hypothesis test algorithms 
including, but not limited to, a Sequential Probability Ratio Test (SPRT) algorithm, and a 
Bayesian Sequential Probability (BSP) test algorithm to produce a fault indication based on the 
value of the residual error for at least one process parameter. 

[0079] Figure 6 illustrates the method and system for MSET-based surveillance. The MSET 
surveillance methods as described herein are embodied in one instance within the ANL software 
modules known as sys_mod.c and fault detect.c. Prior to performing surveillance for new 
operating data observations, a MSET fault detector initialization procedure 106 is performed. 
The MSET fault detector initialization procedure 106 takes the variance (V) vector 100 and 
several other constants as its arguments. The initialization procedure makes use of one of a 
plurality of fault detection methods embodied in one instance within the ANL fault_detect.c 
software module, including but not limited to the SPRT method, and the BSP method. The 
MSET surveillance procedure then proceeds by sequentially acquiring and evaluating each new 
data observation until such time as surveillance is completed. Data observations are acquired 
using the observation acquisition procedure 62. For each new observation vector, Xobs, a 
parameter estimate vector, Xest, is produced by the parameter estimation procedure 66 using the 
unpartitioned MSET model 102 with the same pattern recognition operator that was used in the 
MSET training procedure. The residual error vector, R, is computed and is then normalized 
using a residual value normalization procedure 108 that includes subtracting the mean (M) vector 
100 from the value of the residual error. The normalized residual vector is then evaluated using 
the same fault detection procedure 68 that was initialized at the start of the MSET surveillance 
procedure. If the fault detection procedure 68 results in a fault determination by the fault 
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decision procedure 70, the alarm or control action procedure 74 communicates the fault 
information by the conventional communications link 80 (not shown) to the operator console 82 
(not shown) and/or automated process control system 84 (not shown) for corrective action. In the 
fault decision procedure 70, a Bayesian conditional probability test is in general used to reach a 
fault decision based on a series of fault detection results from the fault detection procedure 68. 
The surveillance procedure then repeats for as long as the more data decision procedure 72 
determines that additional surveillance data is available. 

[0080] Limitations of the MSET Training and Surveillance Method and System: 
[0081] In the method and system described above, MSET is trained by the construction of a 
process memory matrix, D, based on historical operating data from all normal operating states of 
the process. MSET creates the process memory matrix by selecting representative process data 
observations (herein termed observation vectors) that characterize the dynamic patterns inherent 
across all operating states of the process. However, if the process can operate in two or more 
distinct modes of operation, then the totality of operating states for all possible operating modes 
must be represented in the process memory matrix to produce an effective MSET model. As the 
number of distinct operating modes of process operation represented in the training data 
increases, one of two limitations occur: 

[0082] Limitation 1. If the total number of observation vectors in the process memory 
matrix is fixed, then the number of data patterns used to represent any single operating mode of a 
process decreases. This directly reduces the accuracy of MSET's parameter estimates, which 
may result in false alarms or reduce the ability of the fault detection procedure to reliably detect 
subtle sensor failures or other process anomalies. 
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[0083] The parameter estimation accuracy of the MSET algorithm is in general an inverse 
power law function of the number of vectors in the process memory matrix. Limitation 1 is 
evident in the example of figure 7 that illustrates the overall parameter estimation error versus 
the number of vectors in the process memory matrix for an unpartitioned MSET model of six 
Space Shuttle Main Engine sensors. 

[0084] Limitation 2. Allowing the number of observation vectors in the process memory 
matrix to increase ameliorates Limitation 1 above, but incurs a computational performance cost. 
The number of computer operations required for MSET to produce a parameter estimate scales 
with the square of the number of observation vectors stored in the process memory matrix. This 
is because the MSET parameter estimation algorithm must perform pattern matching between the 
current operating data vector and each element of the process memory matrix. Pattern matching 
uses the Ginv matrix, the size of which increases as the square of the number of observation 
vectors. Processing time for MSET parameter estimation has been empirically shown to follow a 
square law equation of the form: 

Observation processing time (msec) = A + B* [Number of observation vectors in D] (7) 
[0085] Limitation 2 is evident in the example of figure 8 that illustrates the overall MSET 
parameter estimation processing time on a 300-MHz Pentium II desktop computer versus the 
number of vectors in the D matrix for an unpartitioned MSET model of six Space Shuttle Main 
Engine sensors. 

[0086] Novel Improvements to the MSET Training and Surveillance Procedures: 

[0087] Having described the MSET training and surveillance methods herein above, this 

section describes the novel improvements made by the instant invention when used for MSET 
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training and surveillance, said improvements being applicable to any asset preferably having at 
least two distinct modes of operation. It is explained herein above that it is beneficial to 
minimize the number of vectors in the process memory matrix in order to optimize the 
processing speed of the MSET algorithm. It is further explained herein above that the MSET 
methods require a trade-off to be made between processing time and parameter estimation 
accuracy. In the worst case, this trade-off results in unacceptable performance for a process 
surveillance application. The novel solution to this problem made by the instant invention is to 
use multiple coordinated MSET process submodels, with each submodel trained over a limited 
operating mode state space. With the instant invention, each submodel may be defined to contain 
only the minimum number of observation vectors required to adequately characterize a single 
specific operating mode or related subset of modes. Since only one submodel must be evaluated 
for each data observation presented to MSET during the surveillance procedure, both parameter 
estimation accuracy and processing speed are greatly improved. 

[0088] The following example illustrates an unobvious benefit of the instant invention. 
Consider a process that requires on-line surveillance across multiple modes of operation. Further 
consider that the safety or other critical nature of said surveillance requires fault decision 
performance within a time interval that allows for on-line MSET processing with a process 
memory matrix containing at most 100 vectors. However, further suppose that the desired fault 
detection accuracy requires on-line MSET parameter estimation with a process memory matrix 
containing 300 vectors to adequately characterize the operating mode state space. In the prior art, 
both criteria could not be simultaneously satisfied. The instant invention solves this problem for 
many types of processes and apparatuses by enabling the MSET model designer to partition the 
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operating mode state space and thus produce three 100 vector submodels providing the desired 
level of fault detection sensitivity (300 vectors) while having a processing speed comparable to 
the 100 vector model. This implementation requires only the addition of an operating mode 
determination procedure that selects the appropriate submodel for each new observation 
presented to the MSET system. 
[0089] Improved MSET Training Procedure: 

[0090] An array of MSET process submodels is termed an MSET process model array 
herein. An MSET process model array is one of a plurality of possible implementation specific 
instances of the process model array 50. 

[0091] Figure 9 illustrates the training procedure 20 useful for producing process model 
array 50 or specifically a MSET process model array 50 in accordance with the instant invention. 
The training procedure includes and modifies the MSET training methods described in figure 5 
and illustrated in figure 9 as MSET training procedure 118. With the instant invention, the 
MSET model designer may now individually specify those operating modes for which MSET 
training and surveillance is enabled. The training procedure loops through each defined 
operating mode with the loop controlled by the mode enabled decision procedure 34 and the 
more modes decision procedure 36. If the operating mode is enabled, a MSET process submodel 
114 is created (this is a specific example of process submodel creation procedure 30 when 
employing MSET) for the operating mode. In order to create the MSET process submodel 114, 
the operating mode specific training data subset 28 is first extracted from the training data set 24 
using the operating mode determination procedure 26. This operating mode specific training 
data subset 28 is then used to create the MSET process submodel 1 14 using the same procedures 
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used in the MSET training procedure 1 18 to create an unpartitioned MSET model. Specifically, 
the MSET procedures used in sequence are the MSET model extraction procedure 90 to produce 
the process memory matrix 92, the MSET model initialization procedure 94 to produce the 
inverse similarity matrix 96, and the MSET training data analysis procedure 98 to produce the 
residual mean and variance vectors 100. Note that this series of procedures is grouped in the 
general case as the process submodel creation procedure 30. The process is repeated with each 
loop including a MSET process submodel storage procedure 116 to add the MSET process 
submodel 1 14 to the process model array 50 for each enabled operating mode. At the conclusion 
of the training procedure 20, the operating mode partitioned process model array 50 includes an 
array of individual MSET process submodels 114, one for each enabled operating mode. 
[0092] The process model array 50 is a linear combination of the operating mode specific 
MSET process submodels. The process model array 50 includes the following at a minimum: 

• An array of process memory matrices 92 (D), one for each enabled operating mode; 

• An array of inverse similarity matrices 96 (Ginv), one for each enabled operating 
mode; and 

• An array of residual mean and variance vectors 100 (M and V), one for each enabled 
operating mode. 

[0093] Working together these process submodels provide parameter estimation over the 
entire operating mode state space that the designer has selected for surveillance. An additional 
novel feature of the instant invention is that each of the process submodels in the process model 
array 50 may be of unique dimensions, that is each submodel may contain unique numbers of 
modeled signal parameters and process memory matrix vectors. A process submodel's 
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dimensions may be different than the dimensions selected for any other operating mode thereby 
permitting the unobvious benefit of further optimizing the MSET method and system for the 
surveillance requirements of each individual operating mode of the asset. This is important 
because certain modes of process operation are often more performance or safety critical than 
others. 

[0094] An additional novel feature of the instant invention is that each of the process 
submodels in the process model array 50 may also be specified with unique parameter estimation 
and fault detector settings for each operating mode. This provides the unobvious benefit of 
optimizing MSET surveillance sensitivity and performance by operating mode. Examples of 
optimization by operating mode include, but are not limited to, the following: 

• Selection of the parameter estimation and training algorithm (e.g., the SSA, BART, 
VPR, VSET, PSEM, or other pattern recognition operator) by operating mode; 

• Selection of the SPRT, BSP or other fault detection algorithm by operating mode; 
Selection of the fault detection procedure false alarm probability, missed alarm 

probability, system disturbance magnitude values, or other threshold constants by operating 
mode; 

• Selection of the fault decision procedure algorithm and associated thresholds and 
constants by operating mode. 

[0095] Improved MSET Surveillance Procedure: 

[0096] Figure 10 illustrates a novel method and system for the surveillance procedure 60 
using the MSET process model array 50 as delineated hereinabove. The surveillance procedure 
60 includes and modifies the MSET surveillance methods described in figure 6 and illustrated in 
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figure 10 as MSET surveillance procedure 122, 126. With the instant invention, the MSET 
model designer may now individually specify those operating modes for which MSET 
surveillance is enabled. 

[0097] At the beginning of the surveillance procedure, the fault detection procedures are 
initialized for each enabled process submodel. Initialization of each MSET process submodel 
114 uses the same MSET fault detector initialization procedure 106 used for initialization of the 
unpartitioned MSET model 102. The surveillance procedure thereafter includes an open-ended 
loop for data acquisition and surveillance processing that is terminated by the more data decision 
procedure 72. 

[0098] During surveillance, each new vector of observed signal data values, Xobs, is 
acquired using the data acquisition procedure 40 and the observation acquisition procedure 62. 
Next, the operating mode determination procedure 26 is used to determine the operating mode 
for each new data observation, Xobs, acquired from the asset 12. If the new data observation is 
determined by the mode enabled decision procedure 34 to represent an operating mode that is not 
enabled for MSET surveillance, no further processing is required until the next data observation 
is acquired from the asset 12. Conversely, if the new data observation is determined to represent 
an enabled operating mode, the correct MSET process submodel 1 14 is selected from the MSET 
process model array 50 using the process submodel selection procedure 64 and all required 
process submodel data is loaded into the computer memory. From this point, MSET surveillance 
processing occurs using the same procedures previously described for the MSET method. Once 
surveillance processing is completed, the procedure returns to acquire a new data observation 
from the asset 12. 
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[0099] An unobvious benefit of only performing MSET processing for selected operating 
modes is that the MSET process model array 50 does not need to provide parameter estimation 
capabilities for those operating modes that do not require on-line surveillance. For example, it 
may be desirable to exclude certain modes of operation (or non-operation) from the MSET 
process model array 50 even though such modes are included within the training data set 24. The 
ability to explicitly exclude operating modes that do not require surveillance simplifies the 
training data acquisition procedures and minimizes the on-line processing time required for a 
parameter estimation based surveillance method. 

[0100] Neural Network Method and System for Determining Operating Mode of Asset: 
[0101] A method to determine the operating mode of the asset 12 is required for both the 
training procedure 20 and the surveillance procedure 60 using an operating mode partitioned 
process model array 50. For each new data observation, the operating mode determination 
procedure 26 must classify the observation as belonging to exactly one of a plurality of defined 
operating modes thereby allowing the required process submodel to be selected for training or 
surveillance. The operating mode determination procedure 26 may use any form of algorithm 
that can determine the current operating mode of the asset 12 based on one or more data 
observations from the asset. The specific implementation or type of the operating mode 
determination procedure 26 does not affect or modify the operation of the instant invention. 
[0102] In an embodiment of the invention, a Learning Vector Quantization (LVQ) neural 
network is used for the operating mode determination procedure 26. The LVQ neural network 
procedure is generally applicable to a wide range of assets. An LVQ neural network model is 
created for a specific asset using conventional neural network training algorithms to learn the 
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inherent operating mode relationships within a set of historical process operating data. The 
trained LVQ model is then used to perform the operating mode determination procedure when 
presented with each new data observation. Because the LVQ neural network is trained by pattern 
matching a vector of observations from historical data, this type of neural network will always 
determine the most similar operating mode when presented with a new data observation. 
[0103] An LVQ neural network is a two-layer, pattern classification neural network in which 
each output node represents a particular class or category. 

[0104] Figure 1 1 illustrates the architecture of an LVQ neural network. An LVQ network is 
one of a group of related pattern classification neural network models that can be used to cluster 
a set of s-element input vectors {X} = {xi, x i5 x s } into t clusters. The input nodes of the 
neural network draw data either directly from sensor signals or from the output of a mathematical 
function applied to one or more sensor signals. An input vector is defined as the set of data 
values, one value for each input node that is derived from the sensor signals at a given moment in 
time. The output nodes of the network correspond to one of the classes (herein, the operating 
modes) recognized by the neural network. During operation of the neural network, an input 
vector is presented to the network, passes through the network, and activates one of the t output 
nodes (yi, yj, y t ). Each of the output nodes corresponds to one of the classes recognized by 
the neural network. The LVQ neural network returns the class corresponding to the activated 
output node, thereby determining the current operating mode of the asset. 
[0105] The input nodes are connected to the output nodes by a set of connection weights. 
The subset of connection weights that connect all of the input nodes to one of the output nodes is 
called a weight vector. For example, output node yj is connected to the input nodes by weight 
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vector {Wj} = {wy, wy, w s j}. An LVQ neural network that contains s input nodes and t 
output nodes would contain a total of t weight vectors, with each weight vector containing s 
connection weights. 

[0106] An LVQ neural network is designed to recognize a predefined set of classes. Each 
one of the classes corresponds to a distinct operating mode of the asset under surveillance. 
During training of an LVQ neural network, the designer decides how many output nodes will be 
used to model each of the operating modes classified by the network. More than one output node 
can be used to represent a class (operating mode) recognized by the neural network. By using 
more than one node to represent a class, the number of neural network connection weights 
dedicated to that class is increased. This improves the ability of the neural network to recognize 
an operating mode of the asset. For each of the r classes, the designer specifies the number of 
output nodes that will model that class. 

[0107] A supervised training scheme is used for training an LVQ neural network. In this 
scheme, training is accomplished by presenting a sequence of matched pairs of input vectors and 
target vectors to the neural network, causing some of the network's connection weights to be 
adjusted with each presentation of a training pair. The target vector {T} = {ti, tj, t t } is a set 
of binary values, one value for each output node in the network. An element of a target vector 
has a value of one if the corresponding output node represents the correct class for the input 
vector. Conversely, an element of a target vector has a value of zero if the corresponding output 
node represents an incorrect class for the input vector. 

[0108] For each training pair presented to the LVQ network, the Euclidean distance between 
the input vector and each of the weight vectors is calculated. The Euclidean distances are then 
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ordered, from smallest to largest. Only the weight vectors that produce the smallest two 
distances in the ordered sequence are allowed to learn. This form of learning is called 
competition, because only those weight vectors that produce the best scores (i.e., producing the 
minimum Euclidean distances) are modified during an iteration of the training algorithm. Three 
commonly used learning methods for training an LVQ neural network are herein designated 
LVQl,LVQ2.1,andLVQ3. 

[0109] In the first learning method (LVQ1), only the weight vector that is closest to the 
current input vector (i.e., the weight vector that produces the minimum Euclidean distance) is 
allowed to learn. For each matched pair of input and training vectors presented to an LVQ 
network during training, the Euclidean distance between the input vector and each of the weight 
vectors is calculated and the output node connected to the weight vector that produces the 
minimum Euclidean distance is identified. If the output node that produces the minimum 
Euclidean distance corresponds to the correct operating mode, the connection weights for the 
output vector are positively reinforced as follows. Let the subscript j represent the output node 
whose weight vector produces the minimum Euclidean distance. If the target value for that 
output node is 1 (i.e., tj = 1), then the weight vector for the output node (Wj) is updated by 



where X is the current input vector and X is a scalar parameter called the learning rate that varies 
from 0 to 1. If the output node whose weight vector produces the minimum Euclidean distance 
corresponds to the incorrect operating mode (i.e., tj = 0), the connection weights for the output 
vector are negatively reinforced by 



Wj =Wj + x(x-Wj) 



(8) 



Wj = Wj -Jlfx-Wj) 



(9) 
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[01 10] In the second (LVQ2.1) and third (LVQ3) learning methods, the two weight vectors 
that are closest to the current input vector are identified. These two weight vectors may be 
positively or negatively reinforced depending upon a number of conditions. The most important 
of these conditions is that the two weight vectors are modified only if they are roughly 
equidistant from the input vector. A user-defined control parameter (e), called the window size, 
is used to determine whether or not the two weight vectors are of comparable distances from the 
input vector. The window condition test that must be satisfied by the two closest weight vectors 
is that the ratio of distance between the closest weight vector and the input vector (d c i) to the 
distance between the second closest weight vector and the input vector (dd) must fall within the 
window. Namely, 

^l>1-e and ^*<1+6 (10) 

d c2 d d 

[Oil] The window size is a small user-defined constant with typical values in the range 
0.1 <e<0.5. 

[01 12] In the LVQ2.1 algorithm, a second condition that must be met is that one of the two 
closest weight vectors connects to an output node of the same class as the input vector. While at 
the same time, the other weight vector must connect to an output node of a class that differs from 
the class of the input vector. If both the window and class conditions are met, then the weight 
vector whose output node belongs to the same class as the input vector is positively reinforced 
according to equation (8). Also, the weight vector whose output node belongs to a class that 
differs from that of the input vector is negatively reinforced according to equation (9). 
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[0113] In the LVQ3 algorithm, the two weight vectors that are closest to the input vector are 
allowed to learn as long as the same window and class conditions as in the LVQ2.1 algorithm are 
met. The LVQ3 algorithm contains an additional learning mode. If the two weight vectors that 
are closest to the input vector meet the window condition (i.e., the conditions in equation (10) are 
met), and if both weight vectors connect to output nodes that are of the same class as the input 
vector, then both weight vectors are positively reinforced. Both weight vectors are updated by 

W = W+ 5x(x-w) (11) 
where 8 is a user-defined parameter, called the LVQ3 multiplier, that reduces the learning rate. 
The LVQ3 multiplier is a small constant with typical values in the range 0.1 < 8 < 0.5. 
[0114] The concept behind the LVQ2.1 and LVQ3 learning methods is that as the input 
vectors used for training are presented to the neural network, learning occurs only when an input 
vector is close to two of the weight vectors. In this case, the input vector is near the boundary 
between two weight vectors. Learning occurs in the LVQ2.1 algorithm only if one of the weight 
vectors belongs to the same output class as the input vector and the other weight vector belongs 
to a different class. The weight vector belonging to the correct class is positively reinforced and 
the other vector is negatively reinforced. The LVQ3 algorithm contains the same conditions as 
the LVQ2.1 algorithm. But an additional condition in the LVQ3 algorithm allows the network to 
learn, at a slower rate, if both weight vectors belong to the same class as the input vector. Over 
the course of the iterative training procedure, this technique works to sharply define the 
boundaries between the vector spaces recognized by each weight vector. 

[0115] A set of input vectors and corresponding target vectors are used to train the LVQ 
neural network. The set of input and target vectors is presented to the network and the 
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connection weights are adjusted depending upon the learning algorithm selected. Then, the 
learning rate parameter (k) is decreased by a small amount and the set of input and target vectors 
is passed through the network again. The cycle is repeated until the learning rate decreases to 
zero or until the error rate for the neural network converges. Each training cycle of data 
presentation and learning rate reduction is called an epoch. The maximum number of epochs 
(n ep s) to be performed by the training algorithm is a user-defined control parameter. The learning 
rate decreases linearly with epoch number, with the learning rate decreasing to zero when the 
maximum number of epochs is reached. The initial value of the learning rate (X 0 ) is a user- 
defined control parameter that, along with the maximum the number of epochs, determines the 
rate at which the learning rate is decreased. Specifically, the learning rate is decreased by a factor 
of n ep s / at the end of each epoch. 

[0116] During each training epoch, the error rate for the neural network is calculated. The 
error rate is defined to be the fraction of input vectors that are incorrectly classified by the neural 
network. An input vector is correctly classified if the weight vector that is closest to it connects 
to an output node of the same class as the input vector. As each input vector in the training set is 
passed through the LVQ neural network during a training epoch, the program notes if the input 
vector was correctly or incorrectly classified. The error rate is then given by the ratio of the 
number of incorrectly classified input vectors to the total number of input vectors in the training 
set. By keeping track of the error rate, the training algorithm can be halted as soon as the neural 
network stops learning. 

[0117] The learning methods devised for the LVQ neural network are fine-tuning 
procedures. Only slight modifications are made to the network weight vectors during any 
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training epoch. Therefore to minimize the number of epochs needed to train the neural network, 
the initial values of the weight vectors must be chosen wisely. The simplest method of 
initializing the weight vectors is to randomly select t vectors from the set of input vectors used to 
train the neural network and use them as initial values for the weight vectors, where t is the 
number of output nodes in the network. Although this initialization method works, a better 
method, which in general reduces the number of epochs needed to adequately train the network is 
to use the K-means clustering algorithm to set the initial values of the weight vectors. The K- 
means clustering algorithm is a method that will divide a vector space into K clusters and 
identify the centers of each cluster. The K-means clustering algorithm can be used to divide the 
input vectors used to train the LVQ network into t clusters and use the centers of the clusters as 
the initial values for the weight vectors. 

[0118] The K-mean clustering algorithm is used to initialize the weight vectors as follows. 
For each of the r classes recognized by the network, the input vectors that belong to each class 
are identified and collected into r arrays. Next the output nodes that belong to each class are 
identified. By definition, the number of output nodes that belong to each class is given by the 
nodes-per-class vector (N C | ass ). Then for each class, the K-means clustering algorithm is used to 
cluster the input vectors that belong to the class into a number of clusters that equals the number 
of output nodes that belong to the class. For instance for class j, the K-means clustering 
algorithm is used to divide the input vectors into noutj clusters and to evaluate the centers of the 
clusters. The cluster centers for class j are used to initialize the weight vectors whose output 
nodes belong to the class. The K-means clustering algorithm evaluates cluster centers for the 
class by minimizing the Euclidean distances between each of the input vectors in the class and 
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the cluster center nearest to each. Thus, each cluster center is the mean value of the group of 
input vectors in a cluster domain. The K-means clustering algorithm was found to improve the 
recall capabilities of the neural network over the random initialization scheme, at a minimal 
increase in the computational cost of the training calculations. 

[0119] A trained LVQ neural network operates as follows. At a point in time, a current data 
observation is acquired from the asset 12 and an input vector is constructed. The Euclidean 
distance between the input vector and each of the weight vectors is calculated. The weight vector 
producing the minimum Euclidean distance is found and its corresponding output node is 
activated. The neural network declares the operating mode corresponding to the activated output 
node to be the current operating mode of the asset 12 under surveillance. 

[0120] In Use and Operation: Determining Asset Operating Mode Using Partitioned Model: 
[0121] Operating mode partitioned MSET processing was first reduced to practice by 
applicant in the performance of NASA Contract NAS4-99012 cited hereinabove. Testing 
performed under this contract conclusively demonstrated the reduction to practice for and 
unobvious benefits of the instant invention. The contract final report and new technology 
disclosure documents by applicant, delivered to the United States Government under this contract 
and listed herein below, further describe one embodiment and its reduction to practice, the 
disclosure of which is incorporated in its entirety herein by reference. 

• NASA SBIR Phase I Final Report, "System State Determination for Real-Time 
Sensor Validation," NASA Contract NAS4-99012, 12 June 1999. Publication or disclosure 
restricted to US Government personnel for four years pursuant to Code of Federal Regulations 48 
CFR 52.227-20. 
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. New Technology Report for NASA Contract NAS4-99012, "Phase Partitioning the 
Multivariate State Estimation Technique (MSET) Process for Improved Parameter Estimation 
Performance and Processing Speed," Expert Microsystems, Inc. Document Control Number 
2000-4446, 24 January 2000. Publication or disclosure restricted to US Government personnel 
for four years pursuant to Code of Federal Regulations 48 CFR 52.227-20. 

• New Technology Report for NASA Contract NAS4-99012, "System State 
Classification Using A Learning Vector Quantization (LVQ) Neural Network," Expert 
Microsystems, Inc. Document Control Number 2000-4447, 24 January 2000. Publication or 
disclosure restricted to US Government personnel for four years pursuant to Code of Federal 
Regulations 48 CFR 52.227-20. 

[0122] In the performance of NASA Contract NAS4-99012, a sensor validation software 
module was designed to validate seventeen (17) mission critical telemetry signals for the Space 
Shuttle Main Engine (SSME), as listed in figure 13. These signals were selected based on their 
importance for real-time telemetry monitoring of the three Space Shuttle Main Engines during 
vehicle ascent to orbit. The names listed in figure 13 use standard SSME nomenclature. Data 
from ten nominal Space Shuttle flights, with flights and engine positions as listed in figure 14, 
were selected as the training data for the MSET submodels and LVQ neural network used in the 
performance of this work. 

[0123] A series of parametric studies were performed to determine the LVQ neural network 
configuration and training constants that provide the best performance for SSME operating mode 
determination. The neural network configuration and training constants selected for applicant's 
reduction to practice are defined in figure 12. Ten SSME flight data sets, defined in figure 14, 
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were used to train the neural network. The operating mode determination capability of the LVQ 
neural network was shown to be excellent with operating mode classification error rates of less 
than 2% observed in testing with additional SSME flight data sets that were not used for training 
the neural network. Specifically, figure 15 illustrates three versions of the sensor validation 
software module. The first sensor validation software module, herein denoted the PD module, 
was created by the methods of the instant invention with a process memory matrix (D) size of 
150 vectors for each operating mode partitioned MSET process submodel in the process model 
array. The PD module's MSET process submodels were created using an LVQ neural network 
for the operating mode determination procedure. The second sensor validation software module, 
herein denoted the A150 module, was created by the unpartitioned MSET model creation 
procedure with a process memory matrix (D) size of 150 vectors used in the unpartitioned MSET 
model. This enabled a direct comparison of surveillance performance between the operating 
mode partitioned (instant invention) and unpartitioned models given a constant processing time. 
The third sensor validation software module, herein denoted the A300 module, was created by 
the unpartitioned MSET model creation procedure with a process memory matrix (D) size of 300 
vectors used in the unpartitioned MSET model. The A300 module enabled improved 
surveillance performance for the unpartitioned MSET model case, albeit at the cost of greater 
processing time. 

[0124] Figure 15 further lists the parameter estimation model and fault detector 
configurations used for feasibility testing. 

[0125] The operating mode partitioned sensor validation module (denoted PD) incorporated 
an MSET process model array partitioned into seven (7) modes representative of the primary 
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operating modes of the SSME. The rules used for partitioning the training data for the SSME 
operating modes are provided in figure 16. The two unpartitioned sensor validation modules 
(denoted A 150 and A300) were prepared using exactly the same training data without the benefit 
of operating mode partitioning. 

[0126] The System State Analyzer (SSA) type pattern recognition operator was used in all of 
the MSET models. The fault detection models were all based on the SPRT mean positive and 
mean negative test methods. SPRT is a statistically derived test statistic with an explicit, non- 
zero false alarm probability. For this reason, SPRT fault detectors are generally used in 
combination with a multi-cycle fault decision algorithm to filter out the possible one-cycle SPRT 
alarms. The fault decision procedure was configured using a four (4) out of seven (7) multi-cycle 
decision algorithm. This fault decision procedure will declare a sensor failure whenever any 4 of 
the last 7 observation cycles produce any type of one-cycle SPRT fault detection alarm. 
[0127] Performance testing clearly demonstrated the feasibility and benefits of using the 
operating mode partitioned MSET process model array for real-time sensor signal validation. 
Metrics used to evaluate the test results included the following: 

[0128] Total One Cycle Alarm Count - This is a measure of the total number of SPRT fault 
detector generated alarms for a single simulation run. For nominal cases, this is expected to be a 
near zero number. For failure simulation cases, the number will be non-zero. This metric 
provides a measure of the overall performance of the fault detection procedure. 
[0129] Average Parameter Estimation Error Percentage - This is a measure of the globally 
averaged parameter estimation error. The global averaged error is the sum of the single cycle 
error for all sensors and data observations divided by the total number of sensors and data 
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observations. This metric provides a measure of the overall performance of the parameter 
estimation procedure. 

[0130] Average One Cycle Processing Time - This is a measure of the globally averaged 
single cycle validation processing time. The one cycle processing time is the sum of the 
processing time for all validated data observations divided by the total number of validated data 
observations. The processing time is calculated as the elapsed time between the time of the test 
driver's call to the sensor validation module's surveillance procedure and the time that the 
surveillance procedure returns its results to the test driver. 

[0131] Time to Failure Detection (Failure Simulations Only) - This is a measure of the 
elapsed time between the first observation containing sensor failure data and the observation for 
which the sensor validation module declares the sensor failed. Time to fault detection depends 
on the diagnostic capability of the sensor validation module, the time of failure occurrence and 
the nature and magnitude of the sensor failure. The data herein report the elapsed mission time 
between the initiation of a slow drift in the signal and the time that the drift failure was detected. 
For consistency, all test cases herein used a drift magnitude of 0.2% of the nominal, full power 
level value of the sensor signal applied per second of engine operating time. 
[0132] Signal Error at Failure Detection (Failure Simulations Only) - This is a measure of 
the total accumulated drift error in a sensor signal at the time of failure detection. The data 
reported herein normalize the error at the time of detection in terms of a percentage of the 
nominal, full power level value of the sensor signal. 

[0133] The results tabulated in figures 17 through 22 demonstrate the very significant 
improvement in sensor validation performance achieved using the operating mode partitioned 
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MSET process model array in accordance with the instant invention. The operating mode 
partitioned MSET process model array provided better fault detection sensitivity, lower 
parameter estimation error, and much faster processing time in comparison to the unpartitioned 
MSET models. The operating mode partitioned MSET process model array exhibited zero (0) 
false alarms and zero (0) missed alarms during all testing performed. The results tabulated in 
figures 17 and 18 were generated using an LVQ neural network for the operating mode 
determination procedure. 

[0134] Two test series were performed for comparison of the operating mode partitioned 
sensor validation module to the unpartitioned modules. In the first series, an unpartitioned model 
with a process memory matrix of 300 vectors was constructed (denoted A300). The operating 
mode partitioned model (denoted PD) used a process memory matrix of 150 vectors for each 
individual operating mode. When compared to the 300 vector unpartitioned model, the operating 
mode partitioned process model array in accordance with the instant invention demonstrated: 

• 34% reduction in parameter estimation error; 

• 73% reduction in per cycle processing time; 

• 73% reduction in time to detect a sensor signal drift; 

• 73% reduction in the total signal error at drift failure detection. 

[0135] In addition, the 300 vector unpartitioned model missed two subtle noise failures that 
were properly detected by the operating mode partitioned process model array in accordance with 
the instant invention. 

[0136] In the second series, the operating mode partitioned process model array was 
compared to an unpartitioned model of equivalent run-time speed. To accomplish this, an 
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unpartitioned model with a process memory matrix of 150 vectors was constructed (denoted 
A150). When compared to the 150 vector unpartitioned model, the operating mode partitioned 
process model array in accordance with the instant invention demonstrated: 

• 42% reduction in parameter estimation error; 

• Equivalent per cycle processing time; 

• 77% reduction in time to detect a sensor signal drift; 

• 76% reduction in the total signal error at drift failure detection. 

[0137] In addition, the 150 vector unpartitioned model produced two sensor failure false 
alarms and missed one noise failure in cases that were properly detected by the operating mode 
partitioned process model array in accordance with the instant invention. 

[0138] The operating mode partitioned process model array provides better fault detection 
sensitivity because the operating mode specific MSET process submodels are better able to 
estimate the current value of each observed parameter. This capability of the operating mode 
partitioned process model array is demonstrated by the reduction achieved in the parameter 
estimation error. Reduced parameter estimation error allows the SPRT thresholds for fault 
detection to be set to lower values thereby making the sensor validation model more sensitive to 
the early indications of sensor failure (fewer missed alarms). This phenomenon proportionally 
reduces the time to drift failure detection as illustrated by comparison of the results reported in 
figure 18 to the results reported in figure 20 and figure 22. 

[0139] Parameter estimation error may be traded off against processing time by increasing 
the number of vectors in the process memory matrix. As is evident by comparison of figure 19 
and figure 21, doubling the process memory matrix size increased the single cycle processing 
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time by a factor of four (2 2 ). Operating mode partitioning provides an effectively larger process 
memory matrix without the concomitant penalty in processing time. For example, the operating 
mode partitioned SSME sensor validation module (PD) includes seven active operating modes 
with process memory matrices sized at 150 vectors per mode. This provides an effective process 
memory matrix size of 1050 vectors with processing speed equivalent to a process memory 
matrix containing 150 vectors. A single unpartitioned model of equivalent accuracy would be 49 
(7 2 ) times slower than the operating mode partitioned process model array. 
[0140] Processing speed results demonstrated the real-time monitoring capability of the 
operating mode partitioned process model array. Single observation processing times of 5-msec 
(200 samples/second) were demonstrated with the seventeen (17) sensor SSME sensor validation 
module running on a 300-MHz Pentium II processor. It is reasonable to allocate between 2 and 
50-msec per data cycle for sensor validation processing in SSME real-time control applications. 
The results of this testing show these goals are only attainable with operating mode partitioning 
of the MSET model in accordance with the instant invention. The unobvious benefits of the 
instant invention are therefore demonstrated by this reduction to practice. 
[0141] Alternate Embodiment and In Use and Operation Using A MSET Process Model 
Array for Parameter Estimation and A Rule-Based Logic Sequence for Determining the 
Operating Mode of the Asset: 

[0142] In another embodiment, the same MSET process model array methods and 
procedures described hereinabove were used with a rule-based logic sequence for the operating 
mode determination procedure 26. A rule-based classifier is generally specific to a single type of 
asset and may be implemented in a plurality of forms. A rule-based classifier may use expert 
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system or procedural logic depending on the nature and complexity of the operating modes of the 
asset. In one embodiment herein, procedural logic representing the rules specified in figure 16 
for determining the operating mode of the SSME was reduced to practice using C language 
procedural software as follows. 

Begin Source Code Listing 

/* SSME operating mode determiner function */ 
/* Copyright 1999 by Expert Microsystems, Inc. */ 
/* All Rights Reserved */ 
#define STARTCOMMAND 33024.0 
#defrne SHUTDOWN COMMAND 35328.0 

#define COMMAND_ISSUED(COMVAL,DATUM) ((DATUM > (COMVAL - 1.0)) 

&& (DATUM < (COMVAL + 1 .0))) 
enum SSMEmodes SSME_mode_deterrniner (double *data, enum Boolean initialize) 

{ 

float pc; /* Combustion chamber pressure */ 
float vehcom; /* Vehicle command code */ 
float compc; /* Commanded chamber pressure */ 

static float last_PL=0.0; 

static int cycles_in_start=0; 

static float last_compc=0.0; 

static enum SSME modes last_state=PREFIRE; 

if(initialize) { 
last_PL = 0.0; 
cycles_in_start = 0; 
last_compc = 0.0; 
last_state = PREFIRE; 
return PREFIRE; 

}; 

pc - data[PID63]; /* Chamber pressure is PID63 */ 

vehcom = data[PID280]; /* Vehicle command is PID280 */ 

compc = data[PID287]; /* Commanded chamber pressure is PID287 */ 

/* Take care of special cases first... */ 
if (last_state = PREFIRE) { 
if (COMMANDISSUED (START COMMAND, vehcom)) { 
/* If we're waiting for START and receive START, then we're in TRANSIENT. */ 
last_state = START01; 
return START01; 
} else { 

/* Keep waiting. */ 
last_state = PREFIRE; 
return PREFIRE; 

} 

} else if (last_state = SHUTDOWN || COMMAND ISSUED (SHUTDOWNCOMMAND, vehcom)) { 
/* Once SHUTDOWN is detected, stay in SHUTDOWN until re-initialized. */ 
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last_state = SHUTDOWN; 
return SHUTDOWN; 

} 

if(last_state=START01) { 
if(++cycles_in_start<25) { /* 0 to 1.0 sec */ 

last_compc = compc; 

last_state = START01; 

return START01; 
} else { 

last_state = START12; 
return START 12; 

} 

}; 

if(last_state=START12) { 
if(++cycles__in_start<50) { /* 1.0 to 2.0 sec */ 

last_compc = compc; 

last_state = START12; 

return START 12; 
} else { 

last_state = START24; 
return START24; 

} 

}; 

if(last_state=START24) { 
if(++cycles_in_start<25*4) { /* 2.0 to 4.00 sec minimum */ 
last_compc = compc; 
last_state = START24; 
return START24; 

}; 
}; 

/* ELSE... mainstage operation. */ 

if((last_state=STEADY_LOW || last_state=STEADY_FULL) && fabs(compc-last_compc)<3.35) { 

last_PL = pc; 
last_compc = compc; 
if (compc < 2500.0) { 

last_state = STEAD Y_LOW; 

return STEAD Y_LOW; 
} else { 

last_state = STEAD Y_FULL; 
return STEAD Y_FULL; 

} 

} else { /* In transient */ 
if(fabs (compc - pc) <= (5 * 3.35)) { 
/* Transition to steady-state. */ 
lastPL = pc; 
last_compc = compc; 
if (compc < 2500.0) { 
last_state = STEAD YJLOW; 
return STEAD YJLOW; 
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} else { 

last_state = STEAD Y_FULL; 
return STEAD Y_FULL; 

} 

} else if(last_state==START24) { 
last_PL = pc; 
last_compc = compc; 
return last_state; 

} else if(compc>last_compc || pc<compc) { 
last_PL = pc; 
last_compc = compc; 
lastjtate = UPTHRUST; 
return UPTHRUST; 

} else { 
last_PL = pc; 
last_compc = compc; 
last_state = DOWNTHRUST; 
return DOWNTHRUST; 

}; 
}; 

} 

End Source Code Listing 

[0143] Reduction to practice and performance testing was accomplished using the MSET 
parameter estimation techniques and rule-based operating mode determination procedure 
described hereinabove. Substantially identical test results were achieved using the rule-based 
method and the LVQ neural network method for the operating mode determination procedure 12. 
This was expected because both methods implemented the same operating mode determination 
criteria, as defined in figure 16, albeit using very different means. Reduction to practice using 
both neural network and rule-based methods illustrates that the instant invention may employ any 
one of a plurality of operating mode determination procedures 12 to achieve the benefits 
described herein. 
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[0144] Alternate Embodiment and In Use and Operation Using A Mathematical Process 
Model Array for Parameter Estimation and A Rule-Based Logic Sequence for Determining the 
Operating Mode of the Asset: 

[0145] In yet another embodiment, an array of mathematical models of the asset is used with 
the same rule-based logic sequence for operating mode determination described herein above. 
The mathematical type of process model array 50 is generally specific to a single type of asset 
and may be implemented in a plurality of forms. In the reduction to practice described herein, 
the mathematical process model array 50 was prepared for the operating modes of the SSME, as 
defined in figure 16. This embodiment was first reduced to practice in the performance of NASA 
Contract NAS3-97130. The contract final report, delivered to the United States Government and 
listed hereinbelow, further describes one embodiment and its reduction to practice, the disclosure 
of which is incorporated in its entirety herein by reference. 

• NASA Contract Final Report, "Sensor Validation Tools and SSME Network," 
NASA Contract NAS3-97130, December 1999. Unrestricted distribution. 
[0146] The mathematical process modeling approach taken in this work was to empirically 
derive a plurality of mathematical redundancy relations between related groups of SSME signals. 
For example, figure 23 illustrates a mathematical redundancy relation among three related signals 
using a standard formula for fluid flow line resistance. Additionally, mathematical limit 
relations were defined in the form of threshold comparison checks for the signal values. Engine 
system design relationships and sensor redundancies were used to select the mathematical 
relations used in the mathematical process submodels. A network of these mathematical 
relations was then assembled to create a separate mathematical process submodel for each SSME 
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operating mode. These operating mode specific mathematical process submodels were then 
assembled into a process model array 50 comprised of one mathematical process submodel for 
each operating mode of the SSME. 

[0147] Reduction to practice and performance testing was accomplished using the 
mathematical process model array 50 and the rule-based operating mode determination procedure 
26 described hereinabove. Substantially similar test results were achieved using the 
mathematical process model array 50 and the MSET process model array 50 for parameter 
estimation. 

[0148] Accordingly, in one aspect the present invention provides the surveillance system 
and method having process parameter estimation and operating mode partitioning. 
[0149] In another aspect the present invention provides the system and method as 
characterized above for performing high sensitivity surveillance of a wide variety of assets 
including industrial, utility, business, medical, transportation, financial, and biological processes 
and apparatuses wherein such process and/or apparatus asset preferably has at least two distinct 
modes of operation. 

[0150] In another aspect the present invention provides the system and method as 
characterized above which partitions a parameter estimation model for a process surveillance 
scheme into two or more coordinated submodels each providing improved parameter estimation 
for a single operating mode or related subset of operating modes of the process. 
[0151] In another aspect the present invention provides the system and method as 
characterized above which creates an improved parameter estimation model for a process 



[Continuation Patent Application - 23404- cpa - Page 58] 



surveillance scheme using recorded operating data for an asset to train a parameter estimation 
model. 

[0152] In another aspect the present invention provides the system and method as 
characterized above which provides an improved system and method for surveillance of signal 
sources and detecting a fault or error state of the signal sources enabling responsive action 
thereto. 

[0153] In another aspect the present invention provides the system and method as 
characterized above which provides an improved system and method for surveillance of on-line, 
real-time signals, or off-line accumulated signal data. 

[0154] In another aspect the present invention provides the system and method as 
characterized above for generating an improved virtual signal estimate for at least one process 
parameter given an observation of at least one actual signal from the asset. 
[0155] In another aspect the present invention provides the system and method as 
characterized above which provides an improved system and method for ultra-sensitive analysis 
and modification of asset processes and apparatuses using at least one parameter estimation 
technique for the generation of at least one virtual signal parameter. 

[0156] In another aspect the present invention provides the system and method as 
characterized above which provides an improved system and method for ultra-sensitive analysis 
and modification of asset processes and apparatuses wherein the parameter estimation technique 
used for the generation of at least one virtual signal parameter is a multivariate state estimation 
technique (MSET) having any one of a plurality of pattern recognition matrix operators, training 
procedures, and operating procedures. 
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[0157] In another aspect the present invention provides the system and method as 
characterized above which provides an improved system and method for ultra-sensitive analysis 
and modification of asset processes and apparatuses wherein the parameter estimation technique 
used for the generation of at least one virtual signal parameter is a neural network having any one 
of a plurality of structures, training procedures, and operating procedures. 
[0158] In another aspect the present invention provides the system and method as 
characterized above which provides an improved system and method for ultra-sensitive analysis 
and modification of asset processes and apparatuses wherein the parameter estimation technique 
used for the generation of at least one virtual signal parameter is a mathematical process model 
having any one of a plurality of structures, training procedures, and operating procedures. 
[0159] In another aspect the present invention provides the system and method as 
characterized above which provides an improved system and method for ultra-sensitive analysis 
and modification of asset processes and apparatuses wherein the parameter estimation technique 
used for the generation of at least one virtual signal parameter is an autoregressive moving 
average (ARMA) model having any one of a plurality of structures, training procedures, and 
operating procedures. 

[0160] In another aspect the present invention provides the system and method as 
characterized above which provides an improved system and method for ultra-sensitive analysis 
and modification of asset processes and apparatuses wherein the parameter estimation technique 
used for the generation of at least one virtual signal parameter is a Kalman filter model having 
any one of a plurality of structures, training procedures, and operating procedures. 
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[0161] In another aspect the present invention provides the system and method as 
characterized above which provides a novel system and method for using at least one of a 
plurality of methods to classify the operating mode of an asset for performing high sensitivity 
surveillance. 

[0162] In another aspect the present invention provides the system and method as 
characterized above which provides a novel system and method to classify the operating mode of 
an asset wherein said classification is performed using a mathematical or logic sequence having 
any one of a plurality of structures, training procedures, and operating procedures. 
[0163] In another aspect the present invention provides the system and method as 
characterized above which provides a novel system and method to classify the operating mode of 
an asset wherein said classification is performed using an expert system having any one of a 
plurality of structures, training procedures, and operating procedures. 

[0164] In another aspect the present invention provides the system and method as 
characterized above which provides a novel system and method to classify the operating mode of 
an asset wherein said classification is performed using a neural network having any one of a 
plurality of structures, training procedures, and operating procedures. 

[0165] Moreover, having thus described the invention, it should be apparent that numerous 
structural modifications and adaptations may be resorted to without departing from the scope and 
fair meaning of the instant invention as set forth hereinabove and as described hereinbelow by 
the claims. 



[Continuation Patent Application - 23404- cpa - Page 61] 



